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SPEECH PROCESSING SYSTEM 
The present invention relates to an apparatus for and 
method of determining a quality measure indicative of the 
5 quality of an audio signal. The invention particularly 

relates to a statistical processing of an input speech 
signal to derive this quality measure. 

Being able to provide a measure of the quality of an 
10 input speech signal is beneficial in a number of systems. 

For example, it can be used to control the way in which 
data files may be retrieved from a database or the way in 
which the speech signal may be encoded for onward 
transmission. The speech quality measure may also be 
15 used to control the recognition processing operation in, 

example, a speech recognition system. 

The prior art techniques for determining a quality 
measure of a speech signal rely on comparing the speech 
20 signal with a "clean" reference signal. These techniques 

are also done off-line and are not suited to real-time 
speech quality determination. 



25 



One aim of the present invention is to provide an 
alternative technique for determining a measure of the 
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quality of an input speech signal. In one embodiment, 
the determined quality measure is indicative of the 
signal to noise ratio for the input speech signal. 

According to one aspect, the present invention provides 
an apparatus for determining a quality measure indicative 
of the quality of an audio signal, the apparatus 
comprising: a memory for storing a predetermined function 
which gives a probability density for parameters of a 
predetermined audio model which is assumed to have 
generated a set of received audio signal values; means 
for receiving a set of audio signal values representative 
of an input audio signal; means for applying a set of 
received audio signal values to the stored function to 
give the probability density for the model parameters; 
means for processing the function with said set of 
received audio signal values applied to derive samples of 
parameter values from said probability density; and means 
for analysing at least some of said derived samples of 
parameter values to determine a signal indicative of the 
quality of the received audio signal values. 
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In one embodiment the audio model comprises an auto- 
regressive (AR) part which models speech and a moving 
average (MA) part which models the channel between the 



speech source and the receiver; and wherein the speech 
quality measure is derived from parameters of at least 
one of those parts- For example, the speech quality 
measure may be derived from the AR parameter values or 
from the MA parameter values. Alternatively, it may be 
determined from the variance of some of these parameter 
values . 

Exemplary embodiments of the present invention will now 
be described with reference to the accompanying drawings 
in which: 

Figure 1 is a schematic view of a computer which may be 
programmed to operate in accordance with an embodiment of 
the present invention; 

Figure 2 is block diagram illustrating the principal 
components of a data file annotation system; 

Figure 3 is a schematic diagram of a word and phoneme 
lattice for an example audio string input by a user; 

Figure 4 is block diagram illustrating the principal 
components of a data file retrieval system; 



Figure 5a is a flow diagram illustrating part of the flow 
control during a retrieval operation using the system 
shown in Figure 4; 

Figure 5b is a flow diagram illustrating the remaining 
part of the flow control of the retrieval system shown in 
Figure 4 ; 

Figure 6 is a block diagram representing a model employed 
by a statistical analysis unit which forms part of the 
data file annotation system shown in Figure 2 and the 
data file retrieval system shown in Figure 4; 

Figure 7 is a flow chart illustrating the processing 
steps performed by a model order selection unit forming 
part of the statistical analysis unit shown in Figures 2 
and 4 ; 

Figure 8 is a flow chart illustrating the main processing 
steps employed by a Simulation Smoother which forms part 
of the statistical analysis unit shown in Figures 2 and 
4; 

Figure 9 is a block diagram illustrating the main 
processing components of the statistical analysis unit 



shown in Figures 2 and 4; 

Figure 10 is a memory map illustrating the data that is 
stored in a memory which forms part of the statistical 
analysis unit shown in Figures 2 and 4; 

Figure 11 is a flow chart illustrating the main 
processing steps performed by the statistical analysis 
unit shown in Figure 9 ; 

Figure 12a is a histogram for a model order of an auto 
regressive filter model which forms part of the model 
shown in Figure 6; 

Figure 12b is a histogram for the variance of process 
noise modelled by the model shown in Figure 6; 

Figure 12c is a histogram for a third coefficient of the 
AR filter model; 

Figure 13 is a block diagram illustrating the main 
components of an alternative data annotation system; and 

Figure 14 is a schematic block diagram illustrating the 
form of a user terminal which is operable to retrieve a 



data file from a database located within a remote s 
in response to an input voice query. 



Embodiments of the present invention can be implemented 
on computer hardware, but the embodiment to be described 
is implemented in software which is run in conjunction 
with processing hardware such as a personal computer, 
workstation, photocopier, facsimile machine or the like. 

Figure 1 shows a personal computer (PC) 1 which may be 
programmed to operate an embodiment of the present 
invention. A keyboard 3, a pointing device 5, a 
microphone 7 and a telephone line 9 are connected to the 
PC 1 via an interface 11. The keyboard 3 and pointing 
device 5 allow the system to be controlled by a user. 
The microphone 7 converts the acoustic speech signal of 
the user into an equivalent electrical signal and 
supplies this to the PC 1 for processing. An internal 
modem and speech receiving circuit (not shown) may be 
connected to the telephone line 9 so that the PC 1 can 
communicate with, for example, a remote computer or with 
a remote user. 

The program instructions which make the PC 1 operate in 
accordance with the present invention may be supplied for 



use with an existing PC 1 on, for example, a storage 
device such as a magnetic disc 13, or by downloading the 
software from the Internet (not shown) via the internal 
modem and telephone line 9- 

DATA FILE ANNOTATION 

The operation of a data file annotation system embodying 
the present invention will now be described with 
reference to Figure 2. The system shown in Figure 2 
allows a user to add a voice annotation to a data file 91 
for use in subsequent voice retrieval operations. In 
use, the user selects a data file to be annotated (which 
can be any kind of data file such as a video file, an 
audio file, a multi-media file or the like) . The user 
then speaks the voice annotation towards microphone 7 . 
Corresponding electrical signals output from the 
microphone 7 are then filtered 6y a filter 15 which 
removes unwanted frequencies (in this embodiment 
frequencies above 8 kHz) from the input signal. The 
filtered signal is then sampled (at a rate of 16 kHz) and 
digitised by an analogue to digital converter 17. The 
digitised speech samples are then stored in a buffer 19. 
Sequential blocks (or frames) of speech samples are then 
passed from the buffer 19 to a statistical analysis unit 
21 which performs a statistical analysis of each frame of 
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speech samples in sequence to determine a set of auto 
regressive (AR) coefficients representative of the speech 
within the frame and a measure of the quality of the 
input speech. In this embodiment, the quality measure is 
the variance of the AR coefficients. 

The quality measure is output to a speech quality 
assessor 93 and the AR coefficients are output to a 
speech recognition unit 97. The speech recognition unit 
25 compares the AR coefficients for successive frames of 
speech with a set of stored speech models (not shown), 
which may be template based or Hidden Markov model based, 
to generate a recognition result. In this embodiment, 
the speech recognition unit 97 outputs words and 
phonemes corresponding to the spoken annotation input by 
the user. As shown in Figure 2, the output words and 
phonemes are input "to a data file annotation unit 99 
which also receives an assessment of the speech quality 
output by the speech quality assessor 93. In this 
embodiment, the speech quality assessor 93 determines 
whether or not the input speech is of a high quality 
(i.e. not disturbed by high levels of background noise) 
based on the variance data received from the statistical 
analysis unit 21. In particular, the variance of the AR 
coefficients should be smaller when the speech input is 



of a high quality than when there are high levels of 
noise. The data file annotation unit 99 then generates 
an annotation for the data file 91 from the words and 
phonemes output by the speech recognition unit 97 and the 
speech quality assessment output by the speech quality 
assessor 93. The data file 91 is then stored in the data 
file database 101 and the corresponding annotation data 
is stored in the annotation database 103. 

As those skilled in the art will appreciate , the speech 
quality assessment which is stored with the annotation 
data is useful for subsequent retrieval operations. In 
particular , when the user wishes to retrieve a data file 
91 from the database 101 (using a voice query), it is 
useful to know the quality of the speech that was used to 
annotate the data file and/or the quality of the voice 
query used to retrieve the data file, since this will 
affect the retrieval performance. More specif ically, if 
the voice annotation is of a high quality and the user's 
voice query is also of a high quality, then a stringent 
search of the annotation database 103 should be 
performed, in order to reduce the amount of false 
identifications. In contrast, if the original voice 
annotation is of a low quality or if the user's voice 
query is of a low quality, then a less stringent search 
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of the annotation database 103 should be performed so 
that there is a greater chance of retrieving the correct 
data file 91. The way in which this search is carried 
out will be described in more detail below. 

In this embodiment, the phoneme and word annotation data 
for a data file is stored in the annotation database 103 
as a phoneme and word lattice. Figure 3 schematically 
illustrates the form of the word and phoneme lattice 
generated for the spoken annotation "picture of the Taj 
Mahal". As shown, the word and phoneme lattice 
identifies a number of different phoneme and word 
strings which correspond to this spoken utterance. The 
phoneme and word lattice is an acyclic directed graph 
with a single entry point and a single exit point. It 
represents different parses of the spoken annotation. 
It is not simply a sequence of words with alternatives 
since each word does not have to be replaced by a single 
alternative, one word can be substituted for two or more 
words or phonemes and the whole structure can form a 
substitution for one or more words or phonemes. As those 
skilled in the art of speech recognition will realise, 
the use of phoneme data in addition to word data is more 
robust, because phonemes are dictionary independent and 
allow the system to cope with out of vocabulary words, 



such as names, places, foreign words etc. The use of 
phoneme data is also capable of making the system future 
proof, since it allows data files which are placed into 
the database to be retrieved even when the words are not 
understood by the original automatic speech recognition 
system. 

In this embodiment, the annotation data stored in the 
annotation database 103 has the following general form: 
HEADER 

- time of start 

- flag if word if phoneme if mixed 

- time index associating the location of 
blocks of annotation data within memory to a 
given time point 

- word set used (i.e. the dictionary) 

- phoneme set used 

- the language to : which the language pertains 

- speech quality assessment 
block(i) i=0, 1,2,... 

- node Nj j=0,l,2,... 

- time offset of node from start of block 

- phoneme links (k) k=0 , 1 , 2 , . . . 

- offset to node Nj = N k - Nj (N k is 
node to which link k extends) or if 
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N k is in block(i+l) offset to node Nj 
= N k + N b - Nj (where N b is the number 
of nodes in block(i)) 

- phoneme associated with link(k) 
5 - word links (1) 1=0,1,2... 

-offset to node Nj = Ni - Nj (Nj is 
node to which link 1 extends) or if 
N k is in block(i+l) offset to node N d 
= N k + N b - Nj (where N b is the 
10 number of nodes in block(i)) 

- word associated with link(l) 

The time of start data in the header can identify the 
time and date of transmission of the data. For example 
15 the time of start may include the exact time of the 

spoken annotation and the date on which it was spoken. 

The flag identifying if the annotation data is word 
annotation data, phoneme annotation data or if it is 
20 mixed is provided since not all of the annotation data in 

the annotation database 103 will include the combined 
phoneme and word lattice annotation data discussed above, 
and in this case, a different search strategy may be used 
to search this annotation data. 
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In this embodiment, the annotation data is divided into 
blocks in order to allow the search to jump into the 
middle of the annotation for a given audio data stream. 
The header therefore includes a time index which 
5 associates the location of the blocks of annotation data 

within the memory to a given time offset between the time 
of start and the time corresponding to the beginning of 
the block. 

10 The header also includes data defining the word set used 

(i.e. the dictionary), the phoneme set used and the 
language to which the vocabulary pertains. The header 
may also include details of the automatic speech 
recognition system used to generate the annotation data 
15 and the appropriate settings thereof which are used 

during the generation of the annotation. Finally, as 
discussed above, the header also includes the speech 
quality assessment which identifies whether or not the 
spoken annotation is of a high quality. 

20 

The blocks of annotation data then follow the header and 
identify, for each node in the block, the time offset of 
the node from the start of the block, the phoneme links 
which connect that node to other nodes by phonemes and 
25 word links which connect that node to other nodes by 



words. Each phoneme link and word link identifies the 
phoneme or word which is associated with the link and the 
offset to the current node. For example, if node N 50 is 
linked to node N S5 by a phoneme link, then the offset to 
node N 50 for that link is 5. As those skilled in the art 
will appreciate, using an offset indication like this 
allows the division of the continuous annotation data 
into separate blocks . 

Data File retrieval 

Figure 4 is a block diagram illustrating the form of a 
data file retrieval system which can be used to retrieve 
the annotation data files from the database 101. This 
system may be, for example, a personal computer, a hand 
held device or the like. As shown, in this embodiment, 
the retrieval system is similar to the speech annotation 
systems shown in Figure 2 except that the data file 
annotation unit 99 is replaced with a data file retrieval 
unit 102, and a display 105 is provided for displaying 
the search results. In operation, an input voice query 
is processed in the same way as the spoken annotation 
described above. The phoneme and word data corresponding 
to the user's input query is output from the speech 
recognition unit 97 to the data file retrieval unit 102. 
The data file retrieval unit 102 then searches the 



annotation database 103 using the generated phoneme and 
word data and a speech quality assessment output by the 
speech quality assessor 93 for the input query. The 
results of the search are then output to the user on the 
display 105. 

Figures 5a and 5b are flow charts illustrating the flow 
control of the retrieval system shown in Figure 4 . As 
shown, initially in step slOl, the system awaits an 
input query by the user. Upon receipt of the query , the 
system generates in step si 03, phoneme and word data and 
a quality assessment for the input query ^ Processing 
then proceeds to step sl05 where the data file retrieval 
unit 102 performs a word search in the annotation 
database 103 using the words in the query. The 
processing then proceeds to step sl07 where the data file 
retrieval unit 102 determines whether or not a match has 
been found. If it has, then the data file retrieval 
unit 102 displays the results to the user on the display 
105. 

In this embodiment, the system then allows the user to 
consider the search results and awaits the user's 
confirmation as to whether or not the results correspond 
to the data file the user wishes to retrieve. If it is, 



then the processing proceeds from step sill to the end of 
the processing and the system returns to its idle state 
and awaits the next input query. If, however, the user 
indicates (by, for example, inputting an appropriate 
voice command) that the search results do not correspond 
to the desired data file, then the processing proceeds 
from step sill to step si 12, where the data file 
retrieval unit 102 determines whether or not the user's 
input query is of a high quality. If it is not, then the 
processing proceeds to step si 13 where the data file 
retrieval unit 102 uses the results of the word search 
to select a number of annotations and then performs a 
"relaxed" phoneme search of the selected annotations. 
The phoneme search is "relaxed" in the sense that the 
data file retrieval unit 102 does not discard annotations 
unless the phonemes of the annotation are very different 
to the phonemes for the input query. 

If, on the other hand, the system determines at step sll2 
that the input query is of a high quality, then the 
processing proceeds to step si 14 where the data file 
retrieval unit 102 again uses the results of the word 
search to select annotations and then uses a relaxed 
phoneme search for the selected annotations having a low 
quality assessment and a "stringent" phoneme search for 
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annotations having a high quality assessment. The 
phoneme search is "stringent" in the sense that the data 
file retrieval unit 102 discards annotations quickly in 
the searching operation if there are significant 
5 differences between the annotation phonemes and the query 

phonemes . 

After the phoneme searches have been performed, the 
processing proceeds to step sll5 where the data file 
10 annotation unit 102 determines whether or not a match has 

been found. If a match has been found then the 
processing proceeds to step si 17 where the results are 
displayed to the user on the display 105. If the search 
results are correct, then processing proceeds from step 
15 sll9 to the end of the processing and the system returns 

to its idle state and awaits the next input query. If, 
on the other hand, the user indicates that the search 
results still do not correspond to the desired data file, 
then the processing passes to step sl21 where the data 
20 file retrieval unit 102 queries the user, via the display 

105, whether or not a phoneme search should be performed 
of the whole annotation database 103. If in response to 
this query, the user indicates that such a search should 
be performed, then the processing proceeds to step sl23, 
25 where the data file retrieval unit 102 performs a phoneme 
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search of the entire annotation database 103, again using 
the quality assessments for the input query and for the 
stored annotations to control the search strategy. 

On completion of this search, the data file retrieval 
unit 102 identifies, in step sl25, whether or not a match 
for the user's input query has been found. If a match is 
found, then the processing proceeds to step sl27, where 
the data file retrieval unit 102 causes the search 
results to be displayed to the user on the display 105. 
If the search results are correct, then the processing 
proceeds from step sl29 to the end of the processing and 
the system returns to its idle state and awaits the next 
input query. If on the other hand, the user indicates 
that the search results still do not correspond to the 
desired data file, then processing passes to step sl31, 
where the data file retrieval unit 102 queries the user, 
via the display 105, whether or not the user wishes to 
redefine or amend the search query. If he does, then the 
processing returns to step sl03 where the user's 
subsequent input query is processed in a similar manner. 
If the search is not to be redefined or amended, then the 
search results and the user's initial input query are 
discarded and the system returns to its idle state and 
awaits the next input query. 



Details of the phoneme searches which can be performed in 
steps sll3, sll4 and sl23 are described in co-pending 
applications PCT/GB00/00718 and GB 9925561.4, the 
contents of which are incorporated herein by reference. 

A more detailed description will now be given of the 
statistical analysis unit 21 used in both the data file 
annotation system shown in Figure 2 and the data file 
retrieval system shown in Figure 4 . 

Statistical Analysis Unit - Theory and Overview 

As mentioned above, the statistical analysis unit 21 
analyses the speech within successive frames of the input 
speech signal. In most speech processing systems, the 
frames are overlapping. However, in this embodiment, the 
frames of speech are non-overlapping and have a duration 
of 20ms which, with the 16kHz sampling rate of the 
analogue to digital converter 17, results in a frame size 
of 320 samples. 

In order to perform the statistical analysis on each of 
the frames, the analysis unit 21 assumes that there is an 
underlying process which generated each sample within the 
frame. The model of this process used in this embodiment 
is shown in Figure 6. As shown, the process is modelled 
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by a speech source 31 which generates, at time t = n, a 
raw speech sample s(n). Since there are physical 
constraints on the movement of the speech articulators, 
there is some correlation between neighbouring speech 
5 samples. Therefore, in this embodiment, the speech 

source 31 is modelled by an auto regressive (AR) process. 
In other words, the statistical analysis unit 21 assumes 
that a current raw speech sample (s(n)) can be determined 
from a linear weighted combination of the most recent 
10 previous raw speech samples, i.e.: 

s(n) = a^in-l) + a 2 s(n-2) + + a k s(n-k) + e(n) (1) 

where a x , a 2 a k are the AR filter coefficients 

15 representing the amount of correlation between the speech 

samples; k is the AR filter model order; and e(n) 
represents random process noise which is involved in the 
generation of the raw speech samples. As those skilled in 
the art of speech processing will appreciate, these AR 
2 0 filter coefficients are the same coefficients that the 

linear prediction (LP) analysis estimates albeit using a 
different processing technique. 
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As shown in Figure 6, the raw speech samples s(n) 
generated by the speech source are input to a channel 33 



which models the acoustic environment between the speech 
source 31 and the output of the analogue to digital 
converter 17. Ideally, the channel 33 should simply 
attenuate the speech as it travels from the source 31 to 
the microphone. However, due to reverberation and other 
distortive effects, the signal (y(n)) output by the 
analogue to digital converter 17 will depend not only on 
the current raw speech sample (s(n)) but it will also 
depend upon previous raw speech samples. Therefore, in 
this embodiment, the statistical analysis unit 21 models 
the channel 33 by a moving average (MA) filter, i.e.: 

y (n) = h 0 s{ri) + h x s(n-\) + h 2 s(n-2) + + h r s(n-r) + e(w) (2) 

where y(n) represents the signal sample output by the 
analogue to digital converter 17 at time t = n; h 0/ h x/ 
h 2 ....h r are the channel filter coefficients representing 
the amount of distortion within the channel "33; r is the 
channel filter model order; and £(n) represents a random 
additive measurement noise component. 

For the current frame of speech being processed, the 
filter coefficients for both the speech source and the 
channel are assumed to be constant but unknown. 
Therefore, considering all N samples (where N = 320) in 



22 



the current frame being processed gives: 

s(n) = ot,j(«-1) + a 2 s(n-2) + + a k s(n-k) + e{ri) 

s(n-\) = a l s(n-2) + a 2 s(n-3) + + a k s(n-k-\) + e(n-l) 



(3) 



s(n-N+l) = a^in-N) + a 2 s(H-N-l) + + a k s(n-k-N+l) + e(n-N+l) 

which can be written in vector form as: 

&(n) = S.a + e.(n) 



(4) 



10 



15 



where 



S = 



s(n-l) s(n-2) s(n-3) 
s(n-2) s(n-3) s(n-4) 
s(n-3) s(«-4) s(n-5) 



s(n-N) s(n-N-l) s(n-N-2) 



s(n-k) 
s(n-k-l) 
s(n-k-2) 



s(n-k-N+\) \ Nxk 



and 
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s(n-l) 
s(n-2) 



bcl 



Nxl 



SL(n) 



e(n) 
e(n-l) 
e(n-l) 



e(n-N+l) 
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As will be apparent from the following discussion, it is 
also convenient to rewrite equation ( 3 ) in terms of the 
random error component (often referred to as the 
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residual) e(n). This gives: 



e(n) = s(n) - a x s(n-\) - a 2 s(n-2) - - a k s(n-k) 

e(n-\) = s(n-\) - a l s(n-2) - a 2 s(n-3) - - a k s(n-k-\) 



(5) 
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e(n-N+l) = s(n-N+l) - a x s(n-N) - a 2 s(n-N-\) - - a k s{n-h-N+X) 

which can be written in vector notation as : 

= A&(n) 

where 



A = 



1 


-°\ 


-a 2 


~a 3 . . 


• ~ a k 


0 


0 


0 . 


. o" 


0 


1 


~ a x 


-a 2 . . 


■ -°k-\ 




0 


0 . 


. 0 


0 


0 


1 


-a x . . 


• ~ a k-2 






0 . 


. 0 



(6) 



NxN 
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Similarly, considering the channel model defined by 
equation (2), with h 0 = 1 (since this provides a more 
stable solution), gives: 

q{n) =h x s(n-l)+h 2 s(n-2) + .. +h r s(n-r) +e(w) 
q(n-\) = h x s(n-2)+h 2 s(n-3) + +h r s(n-r-\) +e(w-l) 

(7) 



25 



q{n-N+\) =h l s(n-N) + h 2 s (n-N-l) + + h r s(n-r-N+l) +e(w-A^+l) 
(where q(n) = y(n) - s(n)) which can be written in vector 
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form as: 



where 



q_(ri) = Y.k + £(w) 

5(^-1) s{n-2) s(n-3) . . . s(n-r) 

s(n-2) s(n-3) s(n~4) . . . 5(w-r-l) 

s(«-3) .y(w-4) s(n-5) . . . j(w-r-2) 



r(w-A0 s(n-N-l) s(n-N-2) . . . *(w-r-tf+l) 



(8) 



10 



and 



15 



20 



4 = 



*(«) 



rx7 



9(«-2) 



?(/?-AT+l) 



e(*-l) 

e(n-2) 



z(rt-N+l) 



Nxl 
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In this embodiment, the analysis unit 21 aims to 
determine, amongst other things, values for the AR filter 
coefficients (a) which best represent the observed signal 
samples (y(n)) in the current frame. It does this by 
determining the AR filter coefficients (a) that maximise 
the joint probability density function of the speech 
model, channel model, speech samples and the noise 
statistics given the observed signal samples output from 
the analogue to digital converter 17, i.e. by 
determining : 



25 

™* { P(a,k,h,r,a 2 e ,clm\m) } < 9 ) 



where a e 2 and a £ 2 represent the process and measurement 
noise statistics respectively. As those skilled in the 
5 art will appreciate, this function defines the 

probability that a particular speech model, channel 
model, raw speech samples and noise statistics generated 
the observed frame of speech samples (X(n)) from the 
analogue to digital converter. To do this, the 
10 statistical analysis unit 21 must determine what this 

function looks like. This problem can be simplified by 
rearranging this probability density function using Bayes 
law to give: 



15 



pUWUfrOA.^o')^^ (10) 



As those skilled in the art will appreciate, the 
20 denominator of equation (10) can be ignored since the 

probability of the signals from the analogue to digital 
converter is constant for all choices of model. 
Therefore, the AR filter coefficients that maximise the 
function defined by equation (9) will also maximise the 
2 5 numerator of equation (10). 
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Each of the terms on the numerator of equation (10) will 
now be considered in turn. 

p(s(n) | a, k, cr e 2 ) 
5 This term represents the joint probability density 

function for generating the vector of raw speech samples 
(s(n)) during a frame, given the AR filter coefficients 
(a), the AR filter model order (k) and the process noise 
statistics (o e 2 ). From equation (6) above, this joint 
10 probability density function for the raw speech samples 

can be determined from the joint probability density 
function for the process noise- In particular p(s(n) |a, 
k, o e 2 ) is given by: 



15 



p{s(ri)\a,k 9 o e ) = p(ein)) 



£(w) = &(ri) - Sa 



(11) 



where p(e(n)) is the joint probability density function 
20 for the process noise during a frame of the input speech 

and the second term on the right-hand side is known as 
the Jacobean of the transformation. In this case, the 
Jacobean is unity because of the triangular form of the 
matrix A (see equations (6) above). 



25 
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In this embodiment, the statistical analysis unit 21 
assumes that the process noise associated with the speech 
source 31 is Gaussian having zero mean and some unknown 
variance a e 2 . The statistical analysis unit 21 also 
5 assumes that the process noise at one time point is 

independent of the process noise at another time point. 
Therefore f the joint probability density function for the 
process noise during a frame of the input speech (which 
defines the probability of any given vector of process 
10 noise e(n) occurring) is given by: 



_N 

pU(ri)) = (2tcoJ) 2 exp 



2a 



(12) 



15 



20 



Therefore, the joint probability density function for a 
vector of raw speech samples given the AR filter 
coefficients (a), the AR filter model order (k) and the 
process noise variance (a e 2 ) is given by: 



p(s.(n)\a,k,o 2 e ) = (2nol) 2 exp 



— (s.(n) T z(n) - 2a T Ss.(ri) + a T S T Sa) 



2ot 



(13) 
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p(X(n) | s(n) , h, r, a e 2 ) 

This term represents the joint probability density 



10 
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function for generating the vector of speech samples 
(y(n)) output from the analogue to digital converter 17, 
given the vector of raw speech samples (s(n)), the 
channel filter coefficients (h) , the channel filter model 
order (r) and the measurement noise statistics (a £ 2 ). 
From equation (8), this joint probability density 
function can be determined from the joint probability 
density function for the process noise. In particular , 
P(X(n)|s(n), h, r, o t 2 ) is given by: 



p()L(n)\z(n)M,r,al) = p(z(p)) 



5£(/7) 



(14) 



where p(_£(n)) is the joint probability density function 
for the measurement noise during a frame of the input 
15 speech and the second term on the right hand side is the 

Jacobean of the transformation which again has a value of 



one • 



In this embodiment, the statistical analysis unit 21 
20 assumes that the measurement noise is Gaussian having 

zero mean and some unknown variance a £ 2 . It also assumes 
that the measurement noise at one time point is 
independent of the measurement noise at another time 
point. Therefore, the joint probability density function 
2 5 for the measurement noise in a frame of the input speech 
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will have the same form as the process noise defined in 
equation (12). Therefore, the joint probability density 
function for a vector of speech samples (y(n)) output 
from the analogue to digital converter 17 , given the 
5 channel filter coefficients (h) , the channel filter model 

order (r), the measurement noise statistics (a £ 2 ) and the 
raw speech samples (s(n)) will have the following form: 



10 



/?0<n)k(/i),i,r,a c ) = (27ca e ) 2 exp 



^\ {d(n) T 2(n) - 2h T r<l(n) + h T Y T V b) 



2a! 



(15) 
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As those skilled in the art will appreciate , although 
this joint probability density function for the vector of 
speech samples (y(n)) is in terms of the variable g(n), 
this does not matter since g(n) is a function of y:(n) and 
s(n), and s.(n) is a given variable (ie known) for this 
probability density function. 



P(ik\k) 

20 This term defines the prior probability density function 

for the AR filter coefficients (a) and it allows the 
statistical analysis unit 21 to introduce knowledge about 
what values it expects these coefficients will take. In 
this embodiment, the statistical analysis unit 21 models 

25 this prior probability density function by a Gaussian 



30 



10 



having an unknown variance (a a 2 ) and mean vector (Ma) * 
i.e.: 



_N 

pialKolnJ = (2no 2 a ) 2 exp 



-{a-li/ia-n} 



2g 



(16) 
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By introducing the new variables o a 2 and Ma/ the prior 
density functions (p(o a 2 ) and p(Ma)) for these variables 
must be added to the numerator of equation (10) above. 
Initially, for the first frame of speech being processed 
the mean vector (Ma) can be set to zero and for the 
second and subsequent frames of speech being processed, 
it can be set to the mean vector obtained during the 
processing of the previous frame. In this case, p(Ma) is 
just a Dirac delta function located at the current value 
of Ma and can therefore be ignored. 



With regard to the prior probability density function for 
the variance of the AR filter coefficients, the 
statistical analysis unit 21 could set this equal to some 

20 constant to imply that all variances are equally 

probable. However, this term can be used to introduce 
knowledge about what the variance of the AR filter 
coefficients is expected to be. In this embodiment, 
since variances are always positive, the statistical 

2 5 analysis unit 21 models this variance prior probability 



density function by an Inverse Gamma function having 
parameters a a and p a , i.e.: 



At the beginning of the speech being processed, the 
statistical analysis unit 21 will not have much knowledge 
about the variance of the AR filter coefficients. 
Therefore, initially, the statistical analysis unit 21 
sets the variance a a 2 and the a and (3 parameters of the 
Inverse Gamma function to ensure that this probability 
density function is fairly flat and therefore non- 
informative. However, after the first frame of speech 
has been processed, these parameters can be set more 
accurately during the processing of the next frame of 
speech by using the parameter values calculated during 
the processing of the previous frame of speech. 



This term represents the prior probability density 
function for the channel model coefficients (h) and it 
allows the statistical analysis unit 21 to introduce 
knowledge about what values it expects these coefficients 
to take. As with the prior probability density function 




(17) 



P(h\r) 



10 
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for the AR filter coefficients, in this embodiment, this 
probability density function is modelled by a Gaussian 
having an unknown variance (a h 2 ) and mean vector (]j h ) , 
i.e. : 



p(h\r,a 2 hl i ) = (2na 2 h ) 2 exp 



-(&-*i/(&-uJ 



2ol 



(18) 



Again, by introducing these new variables, the prior 
density functions (p(a h ) and p(M h )) must be added to the 
numerator of equation (10). Again, the mean vector can 
initially be set to zero and after the first frame of 
speech has been processed and for all subsequent frames 
of speech being processed, the mean vector can be set to 
15 equal the mean vector obtained during the processing of 

the previous frame. Therefore, p(ihi) is also just a 
Dirac delta function located at the current value of jj* 
and can be ignored. 



With regard to the prior probability density function for 
the variance of the channel filter coefficients, again, 
in this embodiment, this is modelled by an Inverse Gamma 
function having parameters a h and p h . Again, the variance 
(a h 2 ) and the a and (3 parameters of the Inverse Gamma 
function can be chosen initially so that these densities 



are non-informative so that they will have little effect 
on the subsequent processing of the initial frame. 

p(<r e 2 ) and p(a e 2 ) 

These terms are the prior probability density functions 
for the process and measurement noise variances and 
again, these allow the statistical analysis unit 21 to 
introduce knowledge about what values it expects these 
noise variances will take. As with the other variances, 
in this embodiment, the statistical analysis unit 21 
models these by an Inverse Gamma function having 
parameters a e , p e and a c , P £ respectively. Again, these 
variances and these Gamma function parameters can be set 
initially so that they are non-informative and will not 
appreciably affect the subsequent calculations for the 
initial f rame . 

p(k) and p(r) 

These terms are the prior probability density functions 
for the AR filter model order (k) and the channel model 
order (r) respectively. In this embodiment, these are 
modelled by a uniform distribution up to some maximum 
order. In this way, there is no prior bias on the number 
of coefficients in the models except that they can not 
exceed these predefined maximums. In this embodiment. 
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the maximum AR filter model order (k) is thirty and the 
maximum channel model order (r) is one hundred and fifty. 



10 



15 



Therefore, inserting the relevant equations into the 
numerator of equation (10) gives the following joint 
probability density function which is proportional to 
P(a,k,h,r,o a 2 ,o h 2 ,o e 2 ,o c 2 ,s(n) |y(n) ) : 



N 



(2nol) 2 exp 



-1 
2a? 



(*(«) r «(«) - 2h. T Yq.(ri) + h T Y T Yh) 



x (2tzoI) 2 exp 



_N 

x (27ta 2 ) 2 exp 



2ot 



(*(«) r £(w) - 2a T S£(n) + a T S T S a) 



2ot 



x (2Ttajj) 2 exp 



2oi 



exp 

P o r(« fl ) 


-1 

°aP a 


x exp 

P*r(a,) 


-1 

oap* 


(a 2 )- (a ' +I) 

exp 

P e r(« e ) 


-1 


x exp 

P E r(a e ) 


-1 

aeP E 



(19) 
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Glbbs Saznpl er 

In order to determine the form of this joint probability 
density function, the statistical analysis unit 21 "draws 
samples" from it. In this embodiment, since the joint 
probability density function to be sampled is a complex 
multivariate function, a Gibbs sampler is used which 
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breaks down the problem into one of drawing samples from 
probability density functions of smaller dimensionality. 
In particular, the Gibbs sampler proceeds by drawing 
random variates from conditional densities as follows: 
5 first iteration 



p(Q,k\h°,r^ol\at<>a><>ts-(») 0 ^")) - a 1 ** 1 

0 



5 second iteration 

p(a,k\h. l ,r\al\al\atm l M) - a 2 ,* 2 

0 

etc. 



5 



where (h°, r°, (a e 2 ) 0 , (o £ 2 ) 0 , (a a 2 ) 0 , (a h 2 ) 0 , s(n)°) are 
initial values which may be obtained from the results of 
the statistical analysis of the previous frame of speech, 
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or where there are no previous frames, can be set to 
appropriate values that will be known to those skilled in 
the art of speech processing. 



10 



15 



As those skilled in the art will appreciate, these 
conditional densities are obtained by inserting the 
current values for the given (or known) variables into 
the terms of the density function of equation ( 19 ) . For 
the conditional density p(a,k|...) this results in: 



p(a,k\...) « exp 



-1 
2c? 



(i(«) r 4(n) - 2a T Ss.(n) + a T S T S a) 



x exp 



(a-\L) T {a-\L) 



2ot 



which can be simplified to give: 



(20) 



20 



p(a,k\ . ) « exp 



+ - 2a 



+ a 



+ 

2 2 



(21) 



which is in the form of a standard Gaussian distribution 
having the following covariance matrix: 
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S T S 



(22) 
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The mean value of this Gaussian distribution can be 
determined by differentiating the exponent of equation 
(21) with respect to a and determining the value of a 
which makes the differential of the exponent equal to 
zero. This yields a mean value of: 



S T S I 
+ — 



2 2 



2 2 



(23) 



A sample can then be drawn from this standard Gaussian 
10 distribution to give a* (where g is the g th iteration of 

the Gibbs sampler) with the model order (k*) being 
determined by a model order selection routine which will 
be described later. The drawing of a sample from this 
Gaussian distribution may be done by using a random 
15 number generator which generates a vector of random 

values which are uniformly distributed and then using a 
transformation of random variables using the covariance 
matrix and the mean value given in equations (22) and 
(23) to generate the sample. In this embodiment, 
20 however, a random number generator is used which 

generates random numbers from a Gaussian distribution 
having zero mean and a variance of one. This simplifies 
the transformation process to one of a simple scaling 
using the covariance matrix given in equation (22) and 
25 shifting using the mean value given in equation (23). 
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Since -the techniques for drawing samples from Gaussian 
distributions are well known in the art of statistical 
analysis, a further description of them will not be given 
here. A more detailed description and explanation can be 
found in the book entitled "Numerical Recipes in C", by 
W. Press et al, Cambridge University Press, 1992 and in 
particular at chapter 7 . 

As those skilled in the art will appreciate, however, 
before a sample can be drawn from this Gaussian 
distribution, estimates of the raw speech samples must be 
available so that the matrix S and the vector s(n) are 
known. The way in which these estimates of the raw 
speech samples are obtained in this embodiment will be 
described later . 



A similar analysis for the conditional density p(h,r | . . . ) 
reveals that it also is a standard Gaussian distribution 
but having a covariance matrix and mean value given by: 



Y 1 Y I 
+ — 

2 2 



-1 



Y T Y 



-l 



Y T qin) 4i, 



(24) 



from which a sample for h* can be drawn in the manner 
described above, with the channel model order (r*) being 
determined using the model order selection routine which 
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will be described later. 

A similar analysis for the conditional density p(a e 2 | . . . ) 
shows that : 



N 



P(Pel ") ~ 2eX P 



-E 



2a! 



P.r<<0 



exp 



-1 



(25) 



where : 



10 



E = &(n)'&(ri) - 2a J S&(n) + a T S T S a 



which can be simplified to give: 



15 



P(?e\-) " 



exp 



-1 


* 4 


2 


1 2 M 



(26) 



which is also an Inverse Gamma distribution having the 
following parameters : 



20 



a = — + a and B = 

2 2 + P e .£ 



(27) 
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A sample is then drawn from this Inverse Gamma 
distribution by firstly generating a random number from 
a uniform distribution and then performing a 



transformation of random variables using the alpha and 
beta parameters given in equation (27), to give (a e 2 )9. 



A similar analysis for the conditional density p(o € 2 \ ...) 
reveals that it also is an Inverse Gamma distribution 
having the following parameters: 



where ; 



N ~ 2p p 

a, - - ♦ a, and K - -— (28) 



E* = %(ri) T q_(ri) - 2h T Yq.(n) + h T Y T Y h 

A sample is then drawn from this Inverse Gamma 
distribution in the manner described above to give (a £ 2 )^. 

A similar analysis for conditional density p(a a 2 |...) 
reveals that it too is an Inverse Gamma distribution 
having the following parameters: 



2 + pja-ii/ia-iLj 



- — + a and B = t ?q\ 



A sample is then drawn from this Inverse Gamma 
distribution in the manner described above to give (a a 2 )9. 



Similarly, the conditional density p(o h 2 |...) is also an 
Inverse Gamma distribution but having the following 
parameters : 



N ~ 2 h 
& /, = - + and h = — 7^7 ~ (30) 



A sample is then drawn from this Inverse Gamma 
distribution in the manner described above to give (a h 2 ) g . 



As those skilled in the art will appreciate, the Gibbs 
sampler requires an initial transient period to converge 
to equilibrium (known as burn-in). Eventually, after L 
iterations, the sample (a L , k L , h L , r L , (a e 2 ) L , (a £ 2 ) L , 
<o a 2 ) L , (o h 2 ) L , s(n) L ) is considered to be a sample from the 
joint probability density function defined in equation 
(19). In this embodiment, the Gibbs sampler performs 
approximately one hundred and fifty (150) iterations on 
each f rame of input speech and discards the samples from 
the first fifty iterations and uses the rest to give a 
picture (a set of histograms) of what the joint 
probability density function defined in equation (19) 
looks like. From these histograms, the set of AR 
coefficients (a) which best represents the observed 
speech samples (y(n)) from the analogue to digital 
converter 17 are determined. The histograms are also 



used to determine appropriate values for the variances 
and channel model coefficients (h) which can be used as 
the initial values for the Gibbs sampler when it 
processes the next frame of speech. 

Model Order Selection 

As mentioned above, during the Gibbs iterations, the 
model order (k) of the AR filter and the model order (r) 
of the channel filter are updated using a model order 
selection routine. In this embodiment, this is performed 
using a technique called "Reversible jump Markov chain 
Monte Carlo computation". This technique is described in 
the paper entitled "Reversible jump Markov chain Monte 
Carlo Computation and Bayesian model determination" by 
Peter Green, Biometrika, vol 82, pp 711 to 732, 1995. 

Figure 7 is a flow chart which illustrates the processing 
steps performed during this model order selection routine 
for the AR filter model order (k). As shown, in step si, 
a new model order (k 2 ) is proposed. In this embodiment, 
the new model order will normally be proposed as k 2 = k x 
± 1, but occasionally it will be proposed as k 2 = k x ± 2 
and very occasionally as k 2 = kj ± 3 etc. To achieve 
this, a sample is drawn from a discretised Laplacian 
density function centred on the current model order ( ki ) 
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and with the variance of this Laplacian density function 
being chosen a priori in accordance with the degree of 
sampling of the model order space that is required. 

The processing then proceeds to step s3 where a model 
order variable (MO) is set equal to: 

!p(a , k 2 | . . . ) 
, 2> 7 , r , 1\ (31) 
P (A <l:* l >'*l'--- ) 

10 where the ratio term is the ratio of the conditional 

probability given in equation (21) evaluated for the 
current AR filter coefficients (a) drawn by the Gibbs 
sampler for the current model order (kj) and for the 
proposed new model order (k 2 ) . If k 2 > k X/ then the 
15 matrix S must first be resized and then a new sample 

must be drawn from the Gaussian distribution having the 
mean vector and covariance matrix defined by equations 
(22) and (23) (determined for the resized matrix S), to 
provide the AR filter coefficients (a <1:Je2> ) for the new 
20 model order (k 2 ). If k 2 < k a then all that is required is 

to delete the last (k 2 - k 2 ) samples of the a vector. If 
the ratio in equation (31) is greater than one, then this 
implies that the proposed model order (k 2 ) is better than 
the current model order whereas if it is less than one 
25 then this implies that the current model order is better 
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than the proposed model order. However, since 

occasionally this will not be the case, rather than 
deciding whether or not to accept the proposed model 
order by comparing the model order variable (MO) with a 
5 fixed threshold of one, in this embodiment, the model 

order variable (MO) is compared, in step s5, with a 
random number which lies between zero and one. If the 
model order variable (MO) is greater than this random 
number, then the processing proceeds to step s7 where the 

10 model order is set to the proposed model order (k 2 ) and 

a count associated with the value of k 2 is incremented. 
If, on the other hand, the model order variable (MO) is 
smaller than the random number, then the processing 
proceeds to step s9 where the current model order is 

15 maintained and a count associated with the value of the 

current model order (k x ) is incremented. The processing 
then ends. 



This model order selection routine is carried out for 
20 both the model order of the AR filter model and for the 

model order of the channel filter model . This routine 
may be carried out at each Gibbs iteration. However, 
this is not essential. Therefore, in this embodiment, 
this model order updating routine is only carried out 
25 every third Gibbs iteration. 



Simula tion Smoother 

As mentioned above, in order to be able to draw samples 
using the Gibbs sampler, estimates of the raw speech 
samples are required to generate s(n), S and Y which are 
used in the Gibbs calculations. These could be obtained 
from the conditional probability density function 
p(.s(n) | • • • ) • However, this is not done in this 
embodiment because of the high dimensionality of S(n). 
Therefore, in this embodiment, a different technique is 
used to provide the necessary estimates of the raw speech- 
samples. In particular, in this embodiment, a 
"Simulation Smoother" is used to provide these estimates. 
This Simulation Smoother was proposed by Piet de Jong in 
the paper entitled "The Simulation Smoother for Time 
Series Models", Biometrika (1995), vol 82,2, pages 339 to 
350. As those skilled in the art will appreciate, the 
Simulation Smoother is run before the Gibbs Sampler. It 
is also run again during the Gibbs iterations in order to 
update the estimates of the raw speech samples. In this 
embodiment, the Simulation Smoother is run every fourth 
Gibbs iteration. 

In order to run the Simulation Smoother, the model 
equations defined above in equations (4) and (6) must be 
written in "state space" format as follows: 
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£(«) = A £(n-\) + £(«) 
y(n) = t J .lin-l) + e(«) 



(32) 



10 
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20 



where 



and 



A = 



a, a 2 a 3 
1 0 0 
0 1 0 



a k 0 

0 0 
0 0 



1 0 



m 

s(n-l) 
£(n-2) 



S(n-r+l) 



tin) 



rxl 



e(ri) 
0 
0 



rxl 



With this state space representation, the dimensionality 
of the raw speech vectors (s.(n)) and the process noise 
vectors (e(n)) do not need to be Nxl but only have to be 
as large as the greater of the model orders - k and r. 
Typically, the channel model order (r) will be larger 
than the AR filter model order (k) . Hence, the vector of 
raw speech samples (§(n) ) and the vector of process noise 
(e(n)) only need to be rxl and hence the dimensionality 
of the matrix A only needs to be rxr. 
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The Simulation Smoother involves two stages - a first 
stage in which a Kalman filter is run on the speech 
samples in the current frame and then a second stage in 
which a "smoothing" filter is run on the speech samples 
5 in the current frame using data obtained from the Kalman 

filter stage- Figure 8 is a flow chart illustrating the 
processing steps performed by the Simulation Smoother. 
As shown, in step s21, the system initialises a time 
variable t to equal one. During the Kalman filter stage, 
10 this time variable is run from t = 1 to N in order to 

process the N speech samples in the current frame being 
processed in time sequential order. After step s21, the 
processing then proceeds to step s23, where the following 
Kalman filter equations are computed for the current 
15 speech sample (y(t)) being processed: 

| w(t) = y(t) - h T m 

d(t) = k T P(t)h + cl 
kit) = (AP(t)k).d(ty l 

(33) 

=* Al(t) + k f (0M0 

20 

UO =A - k f (t).k T 
P(t+\) = AP{t)L{t) T + a 2 e .I 

where the initial vector of raw speech samples (s.(l)) 
includes raw speech samples obtained from the processing 
25 of the previous frame (or if there are no previous frames 
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then s(i) is set equal to zero for i < 1); P(l) is the 
variance of s.(l) (which can be obtained from the previous 
frame or initially can be set to a e 2 ); h is the current 
set of channel model coefficients which can be obtained 
from the processing of the previous frame (or if there 
are no previous frames then the elements of h can be set 
to their expected values - zero); y(t) is the current 
speech sample of the current frame being processed and I 
is the identity matrix. The processing then proceeds to 
step s25 where the scalar values w(t) and d(t) are stored 
together with the rxr matrix L(t) (or alternatively the 
Kalman filter gain vector k f (t) could be stored from 
which L(t) can be generated). The processing then 
proceeds to step s2 7 where the system determines whether 
or not all the speech samples in the current frame have 
been processed. If they have not, then the processing 
proceeds to step s29 where the time variable t is 
incremented by one so that the next sample in the current 
frame will be processed in the same way. Once all N 
samples in the current frame have been processed in this 
way and the corresponding values stored, the first stage 
of the Simulation Smoother is complete. 

The processing then proceeds to step s31 where the second 
stage of the Simulation Smoother is started in which the 



smoothing filter processes the speech samples in the 
current frame in reverse sequential order. As shown, in 
step s31 the system runs the following set of smoothing 
filter equations on the current speech sample being 
processed together with the stored Kalman filter 
variables computed for the current speech sample being 
processed: 

C(f) = o 2 e {l - o 2 e U(t)) 

u(0~*(o,C(i)) 

V{t) = o 2 e U(t)L(t) 

n(t'\) = hd(ty l w(t) + wfm - v(t) T C(ty l n(t) 

(34) 

U{t-\) = hd(ty l h T + L(ifU(t)L(f) + V(t) T C{ty x V(t) 

eif) = a 2 e r{i) + ij(0 where l(t) = [e(t) e(t~l) e(t-2) ... e(t-r+\)] T 
l(t) = Ai(t-1) + m where i(t) = [s(t) s(t-l) s(t-2) ... s(t-r+l)] T 

and = [e(t) 0 0 ... 0 ] T 

where n("t) is a sample drawn from a Gaussian distribution 
having zero mean and covariance matrix C(t); the initial 
vector r(t=N) and the initial matrix U(t=N) are both set 
to zero; and .s(O) is obtained from the processing of the 
previous frame (or if there are no previous frames can be 
set equal to zero) . The processing then proceeds to step 
s33 where the estimate of the process noise (e(t)) for 
the current speech sample being processed and the 
estimate of the raw speech sample (s(t)) for the current 



speech sample being processed are stored. The processing 
then proceeds to step s35 where the system determines 
whether or not all the speech samples in the current 
frame have been processed. If they have not, then the 
processing proceeds to step s37 where the time variable 
t is decremented by one so that the previous sample in 
the current frame will be processed in the same way. 
Once all N samples in the current frame have been 
processed in this way and the corresponding process noise 
and raw speech samples have been stored, the second stage 
of the Simulation Smoother is complete and an estimate of 
s(n) will have been generated. 

As shown in equations (4) and (8), the matrix S and the 
matrix Y require raw speech samples s(n-N-l) to s(n-N- 
k+1) and s(n-N-l) to s(n-N-r+l) respectively in addition 
to those in s(n). These additional raw speech samples 
can be obtained either from the processing of the 
previous frame of speech or if there are no previous 
frames, they can be set to zero. With these estimates of 
raw speech samples, the Gibbs sampler can be run to draw 
samples from the above described probability density 
functions . 



Statistical Analysis Unit - Operation 

A description has been given above of the theory 
underlying the statistical analysis unit 21. A 
description will now be given with reference to Figures 
9 to 11 of the operation of the statistical analysis unit 
21 that is used in the embodiment. 

Figure 9 is a block diagram illustrating the principal 
components of the statistical analysis unit 21 of this 
embodiment. As shown , it comprises the above described 
Gibbs sampler 41, Simulation Smoother 43 (including the 
Kalman filter 43-1 and smoothing filter 43-2) and model 
order selector 45. It also comprises a memory 47 which 
receives the speech samples of the current frame to be 
processed, a data analysis unit 49 which processes the 
data generated by the Gibbs sampler 41 and the model 
order selector 4 5 and a controller 50 which controls the 
operation of the statistical analysis unit 21. 

As shown in Figure 9, the memory 47 includes a non 
volatile memory area 47-1 and a working memory area 47-2. 
The non volatile memory 4 7-1 is used to store the joint 
probability density function given in equation (19) above 
and the equations for the variances and mean values and 
the equations for the Inverse Gamma parameters given 



above in equations (22) to (24) and (27) to (30) for the 
above mentioned conditional probability density functions 
for use by the Gibbs sampler 41. The non volatile memory 
47-1 also stores the Kalman filter equations given above 
in equation (33) and the smoothing filter equations given 
above in equation 34 for use by the Simulation Smoother 
43. 

Figure 10 is a schematic diagram illustrating the 
parameter values that are stored in the working memory 
area (RAM) 47-2. As shown, the RAM includes a store 51 
for storing the speech samples y f (1) to y f (N) output by 
the analogue to digital converter 17 for the current 
frame (f) being processed. As mentioned above, these 
speech samples are used in both the Gibbs sampler 41 and 
the Simulation Smoother 43. The RAM 47-2 also includes 
a store 53 for storing the initial estimates of the model 
parameters (g=0) and the M samples (g = 1 to M) of each 
parameter drawn from the above described conditional 
probability density functions by the Gibbs sampler 41 for 
the current frame being processed. As mentioned above, 
in this embodiment, M is 100 since the Gibbs sampler 41 
performs 150 iterations on each frame of input speech 
with the first fifty samples being discarded. The RAM 
47-2 also includes a store 55 for storing W(t), d(t) and 
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L(t) for t = 1 to N which are calculated during the 

processing of the speech samples in the current frame of 

speech by the above described Kalman filter 43-1. The 

RAM 47-2 also includes a store 57 for storing the 

estimates of the raw speech samples (s f (t)) and the 

estimates of the process noise (e f (t)) generated by the 

« 

smoothing filter 43-2, as discussed above. The RAM 47-2 
also includes a store 59 for storing the model order 
counts which are generated by the model order selector 45 
when the model orders for the AR filter model and the 
channel model are updated. 

Figure 11 is a flow diagram illustrating the control 
program used by the controller 50 , in this embodiment , to 
control the processing operations of the statistical 
analysis unit 21. As shown, in step s41, the controller 
50 retrieves the next frame of speech samples to be 
processed from the buffer 19 and stores them in the 
memory store 51. The processing then proceeds to step 
s43 where initial estimates for the channel model, raw 
speech samples and the process noise and measurement 
noise statistics are set and stored in the store 53. 
These initial estimates are either set to be the values 
obtained during the processing of the previous frame of 
speech or, where there are no previous frames of speech, 



are set to their expected values (which may be zero) . 
The processing then proceeds to step s45 where the 
Simulation Smoother 43 is activated so as to provide an 
estimate of the raw speech samples in the manner 
described above. The processing then proceeds to step s47 
where one iteration of the Gibbs sampler 41 is run in 
order to update the channel model, speech model and the 
process and measurement noise statistics using the raw 
speech samples obtained in step s45. These updated 
parameter values are then stored in the memory store 53. 

The processing then proceeds to step s49 where the 
controller 50 determines whether or not to update the 
model orders of the AR filter model and the channel 
model. As mentioned above, in this embodiment, these 
model orders are updated every third Gibbs iteration. If 
the model orders are to be updated, then the processing 
proceeds to step s51 where the model order selector 45 is 
used to update the model orders of the AR filter model 
and the channel model in the manner described above. If 
at step s49 the controller 50 determines that the model 
orders are not to be updated, then the processing skips 
step s51 and the processing proceeds to step s53. At 
step s53, the controller 50 determines whether or not to 
perform another Gibbs iteration. If another iteration is 



to be performed, then the processing proceeds to decision 
block s55 where the controller 50 decides whether or not 
to update the estimates of the raw speech samples (s(t)) . 
If the raw speech samples are not to be updated, then the 
processing returns to step s47 where the next Gibbs 
iteration is run. 

As mentioned above, in this embodiment, the Simulation 
Smoother 43 is run every fourth Gibbs iteration in order 
to update the raw speech samples. Therefore, if the 
controller 50 determines, in step s55 that there has been 
four Gibbs iterations since the last time the speech 
samples were updated, then the processing returns to step 
s45 where the Simulation Smoother is run again to provide 
new estimates of the raw speech samples (s(t)). Once the 
controller 50 has determined that the required 150 Gibbs 
iterations have been performed, the controller 50 causes 
the processing to proceed to step s57 where the data 
analysis unit 49 analyses the model order counts 
generated by the model order selector 45 to determine the 
model orders for the AR filter model and the channel 
model which best represents the current frame of speech 
being processed. The processing then proceeds to step 
s59 where the data analysis unit 49 analyses the samples 
drawn from the conditional densities by the Gibbs sampler 



41 to determine the AR filter coefficients (a) , the 
channel model coefficients (h) , the variances of these 
coefficients and the process and measurement noise 
variances which best represent the current frame of 
speech being processed. The processing then proceeds to 
step s61 where the controller 50 determines whether or 
not there is any further speech to be processed. If 
there is more speech to be processed, then processing 
returns to step S41 and the above process is repeated for 
the next frame of speech. Once all the speech has been 
processed in this way, the processing ends. 

Data Analysis unit 

A more detailed description of the data analysis unit 49 
will now be given with reference to Figure 12. As 
mentioned above, the data analysis unit 49 initially 
determines, in step s57, the model orders for both the AR 
filter model and the channel model which best represents 
the current frame of speech being processed. It does 
this using the counts that have been generated by the 
model order selector 45 when it was run in step s51. 
These counts are stored in the store 59 of the RAM 47-2- 
In this embodiment, in determining the best model orders, 
the data analysis unit 49 identifies the model order 
having the highest count. Figure 12a is an exemplary 



histogram which illustrates the distribution of counts 
that is generated for the model order (k) of the AR 
filter model. Therefore, in this example, the data 
analysis unit 49 would set the best model order of the AR 
filter model as five. The data analysis unit 49 performs 
a similar analysis of the counts generated for the model 
order (r) of the channel model to determine the best 
model order for the channel model. 

Once the data analysis unit 4 9 has determined the best 
model orders (k and r) , it then analyses the samples 
generated by the Gibbs sampler 41 which are stored in the 
store 53 of the RAM 47-2, in order to determine parameter 
values that are most representative of those samples. 
It does this by determining a histogram for each of the 
parameters from which it determines the most 
representative parameter value. To generate the 

histogram, the data analysis unit 49 determines the 
maximum and minimum sample value which was drawn by the 
Gibbs sampler and then divides the range of parameter 
values between this minimum and maximum value into a 
predetermined number of sub-ranges or bins. The data 
analysis unit 49 then assigns each of the sample values 
into the appropriate bins and counts how many samples 
are allocated to each bin. It then uses these counts to 
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calculate a weighted average of the samples (with the 
weighting used for each sample depending on the count for 
the corresponding bin), to determine the most 
representative parameter value (known as the minimum mean 
square estimate (MMSE ) ) . Figure 12b illustrates an 
example histogram which is generated for the variance 
(a e 2 ) of the process noise, from which the data analysis 
unit 4 9 determines that the variance representative of 
the sample is 0.3149. 

In determining the AR filter coefficients (-a ± for i = i 
to k) , the data analysis unit 49 determines and analyses 
a histogram of the samples for each coefficient 
independently. Figure 12c shows an exemplary histogram 
obtained for the third AR filter coefficient (a 3 ), from 
which the data analysis unit 49 determines that the 
coefficient representative of the samples is -0.4977. 

In this embodiment, the data analysis unit 4 9 outputs the 
AR filter coefficients which are passed to the speech 
recognition unit 9 7 and the AR filter coefficient 
variance which is passed to the speech quality assessor 
93. These parameters (and the remaining parameter values 
determined by the data analysis unit 49) are also stored 
in the RAM 47-2 for use during the processing of the next 



frame of speech. 



As the skilled reader will appreciate, a speech 
processing technique has been described above which uses 
statistical analysis techniques to determine sets of AR 
filter coefficients representative of an input speech 
signal. The technique is more robust and accurate than 
prior art techniques which employ maximum likelihood 
estimators to determine the AR filter coefficients. This 
is because the statistical analysis of each frame uses 
knowledge obtained from the processing of the previous 
frame. In addition, with the analysis performed above, 
the model order for the AR filter model is not assumed to 
be constant and can vary from frame to frame . In this 
way, the optimum number of AR filter coefficients can be 
used to represent the speech within each frame. As a 
result, the AR filter coefficients output by the 
statistical analysis unit 21 will more accurately 
represent the corresponding input speech. Further still, 
since the underlying process model that is used separates 
the speech source from the channel, the AR filter 
coefficients that are determined will be more 
representative of the actual speech and will be less 
likely to include distortive effects of the channel. 
Further still, since variance information is available 



for each of the parameters, this provides an indication 
of the confidence of each of the parameter estimates. 
This is in contrast to maximum likelihood and least 
squares approaches, such as linear prediction analysis, 
where point estimates of the parameter values are 
determined. 

Alternative Embodiments 

In the above embodiment, the statistical analysis unit 
was effectively used as a pre-processor for a speech 
recognition system in order to generate AR coefficients 
representative of the input speech and also to provide a 
measure of the quality of the input speech signal for use 
in annotating a data file for use in subsequent retrieval 
operations. As those skilled in the art will appreciate, 
the AR coefficients and the speech quality measure 
generated by the statistical analysis unit 21 can be used 
in other applications. For example, it can be used in a 
speech transmission system in which speech to be 
transmitted is converted into corresponding AR 
coefficients which are then encoded for transmission. 
Various different encoding techniques may be employed, 
with the particular encoding technique used depending on 
the speech quality assessment output by the speech 
quality assessor. A suitable decoder at the receiver can 



then decode the transmitted data in order to retrieve the 
AR coefficients from which the speech may be 
resynthesised or recognised using a speech recognition 
unit. Alternatively still, the speech quality assessment 
may be used to control the operation of the speech 
recognition unit. In particular, if the reference models 
are high quality and if the user's input speech is also 
of a high quality, then the speech recognition system may 
compare the input speech with the stored models using a 
strict comparison technique. In contrast, if the input 
speech is of a low quality (and/or the models were 
generated from low quality speech) , then the speech 
recognition unit may be arranged to perform a less strict 
comparison of the input speech with the models. 

In addition to the variance of the AR filter coefficients 
being a good measure of the quality of the speech, the 
variance (o e 2 ) of the process noise is also a good measure 
of the quality of the input speech, since this variance 
is also measure of the energy in the process noise. 
Therefore, the variance of the process noise can be used 
in addition to or instead of the variance of the AR 
filter coefficients to provide the quality measure of the 
input speech to the speech quality assessor. Further 
still, one or more of the moving average (MA) 



coefficients may be used in addition to or instead of the 
variance of the AR filter coefficients, to provide the 
speech quality measure. This is because the MA filter 
coefficients represent how much distortion is added to 
the speech signal by the channel. For example, if all 
but the first MA filter coefficient are approximately 
zero, then little distortion will have been added by the 
channel and therefore, the speech quality will be high. 
In contrast, if the MA filter coefficients have larger 
values, then the received input speech will be of low 
quality as a result of the distortions caused by the 
channel . 

In the above embodiment, the statistical analysis unit 21 
operated as the front end to the speech recognition unit 
97. As those skilled in the art will appreciate, in an 
alternative embodiment , a separate preprocessor may be 
provided to generate the AR filter coefficients, or other 
coefficients, such as cepstral coefficients, for use by 
the speech recognition unit 97. Figure 13 illustrates a 
data file annotation system which operates in this way. 
As shown, the speech in the buffer 19 is processed by a 
preprocessor 95 in addition to being processed by the 
statistical analysis unit 21. However, such a separate 
preprocessing of the speech is not preferred, because of 



the additional processing overheads involved. 
Additionally, although a separate data file database 101 
and annotation database 103 were used in the first 
embodiment described above, a single database may be 
used. This is also illustrated in Figure 13 by the 
single database 104. 

In the above embodiment, the speech recognition unit 97 
used the AR filter coefficients output by the statistical 
analysis unit 21. Where the speech recognition unit 97 
operates using different coefficients, then a suitable 
coefficient converter may be provided between the 
statistical analysis unit and the speech recognition 
unit . 

As those skilled in the art will appreciate, this type of 
phonetic and word annotation of data files in a database 
provides a convenient and powerful way to allow a user to 
search the database by voice. In the illustrated 
embodiment, a single voice annotation was stored in the 
database associated with a corresponding data file so 
that the data file can be retrieved later by the user. 
As those skilled in the art will appreciate, when the 
data file to be annotated corresponds to a video data 
file, the annotation data may be generated from the audio 



within the data file itself. In this case, a single 
stream of annotation data may be generated for the audio 
data or separate phoneme and word lattice annotation data 
can be generated for the audio data of each speaker 
within the audio stream. This may be achieved by 
identifying f from the pitch or from another 
distinguishing feature of the speech signals, the audio 
data which corresponds to each of the speakers and then 
by annotating the different speakers audio separately. 
This may also be achieved if the audio data was recorded 
in stereo or if an array of microphones were used in 
generating the audio data, since it is then possible to 
process the audio data to extract the data for each 
speaker. 

In the above embodiment, a data file was annotated using 
a voice annotation. As those skilled in the art will 
appreciate, other techniques can be used to input the 
annotation. For example, the user may type in the 
annotation to be added to the data file. In this case, 
the typed input would be converted by a phonetic 
transcription unit into the phoneme and word lattice 
annotation data using an internal phonetic dictionary. 
Also, in this case, such annotation data would have a 
high quality assessment since it is unlikely that there 



will be any decoding errors. 



In the above embodiments, a phoneme and word lattice was 
used to annotate the data files. As those skilled in the 
art will appreciate, this is not essential. The 
annotation may simply be formed from phonemes or from 
words only. Further, as those skilled in the art will 
appreciate, the word "phoneme" in this context is not 
limited to its linguistic meaning but includes the 
various sub-word units that are identified and used in 
standard speech recognition systems, such as phones, 
syllables, Kata Kana (Japanese alphabet) etc. 

In the above embodiment, the annotation database, the 
data file database and the speech recognition unit were 
all located within the same system. As those skilled in 
the art will appreciate, this is not essential. For 
example, Figure 14 illustrates an embodiment in which the 
database 104 (which includes both the data files and the 
annotations) and the data file retrieval unit 102 are 
located in a remote server 119 and in which a user 
terminal 117 accesses and controls data files in the 
database 104 via the network interface units 125 and 129 
and a data network 127 (such as the Internet). In 
operation, the user inputs a voice query via the 



microphone 7 which is processed by the statistical 
analysis unit 21 in the manner described above. For 
clarity, the filter 15 , A/D converter 17 and the buffer 
19 have been omitted from Figure 14. The AR 

coefficients output by the statistical analysis unit 21 
are passed to the speech recognition unit 97 and the 
variance of the AR coefficients is output to the speech 
quality accesor 93, as before. The phoneme and word data 
output by the speech recognition unit 97 and the speech 
quality assessment output by the speech quality assessor 
93 are input to the control unit 131 which controls the 
transmission of this data over the data network 127 to 
the data file retrieval unit 102 located within the 
remote server 119. Upon receipt of this data, the data 
file retrieval unit 102 searches the database 104 in the 
manner described above. The data retrieved from the 
database 104 or other data relating to the search is then 
transmitted back, via the data network 68, to the control 
unit 131 which controls the display of the appropriate 
data on the display 105. In this way, it is possible to 
retrieve and control data files in the remote server 119 
without using significant computer resources in the 
server (since it is the user terminal 117 which converts 
the input speech into the phoneme and word data and 
provides the speech quality assessment). 
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In the above embodiments, Gaussian and Inverse Gamma 
distributions were used to model the various prior 
probability density functions of equation (19)- As those 
skilled in the art of statistical analysis will 
5 appreciate, the reason these distributions were chosen is 

that they are conjugate to one another. This means that 
each of the conditional probability density functions 
which are used in the Gibbs sampler will also either be 
Gaussian or Inverse Gamma. This therefore simplifies the 
10 task of drawing samples from the conditional probability 

densities. However, this is not essential. The noise 
probability density functions could be modelled by 
Laplacian or student-t distributions rather than Gaussian 
distributions. Similarly, the probability density 
15 functions for the variances may be modelled by a 

distribution other than the Inverse Gamma distribution. 
For example, they can be modelled by a Rayleigh 
distribution or some other distribution which is always 
positive. However, the use of probability density 
20 functions that are not conjugate will result in increased 

complexity in drawing samples from the conditional 
densities by the Gibbs sampler. 

Additionally, whilst the Gibbs sampler was used to draw 
25 samples from the probability density function given in 
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equation (19), other sampling algorithms could be used. 
For example the Metropolis-Hastings algorithm (which is 
reviewed together with other techniques in a paper 
entitled "Probabilistic inference using Markov chain 
Monte Carlo methods" by R. Neal, Technical Report CRG- 
TR_93_1, Department of Computer Science, University of 
Toronto, 1993) may be used to sample this probability 
density - 

In the above embodiment, a Simulation Smoother was used 
to generate estimates for the raw speech samples. This 
Simulation Smoother included a Kalman filter stage and a 
smoothing filter stage in order to generate the estimates 
of the raw speech samples. In an alternative embodiment, 
the smoothing filter stage may be omitted, since the 
Kalman filter stage generates estimates of the raw speech 
(see equation (33)). However, these raw speech samples 
were ignored, since the speech samples generated by the 
smoothing filter are considered to be more accurate and 
robust. This is because the Kalman filter essentially 
generates a point estimate of the speech samples from the 
joint probability density function p( s(n) | a,k,o e 2 ) , 
whereas the Simulation Smoother draws a sample from this 
probability density function. 
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In the above embodiment, a Simulation Smoother was used 
in order to generate estimates of the raw speech samples. 
It is possible to avoid having to estimate the raw speech 
samples by treating them as "nuisance parameters" and 
integrating them out of equation (19). However, this is 
not preferred, since the resulting integral will have a 
much more complex form than the Gaussian and Inverse 
Gamma mixture defined in equation (19) . This in turn will 
result in more complex conditional probabilities 
corresponding to equations (20) to (30). In a similar 
way, the other nuisance parameters (such as the 
coefficient variances or any of the Inverse Gamma, alpha 
and beta parameters) may be integrated out as well. 
However, again this is not preferred, since it increases 
15 the complexity of the density function to be sampled 

using the Gibbs sampler. The technique of integrating 
out nuisance parameters is well known in the field of 
statistical analysis and will not be described further 
here. 
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In the above embodiment, the data analysis unit analysed 
the samples drawn by the Gibbs sampler by determining a 
histogram for each of the model parameters and then 
determining the value of the model parameter using a 
25 weighted average of the samples drawn by the Gibbs 
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sampler with the weighting being dependent upon the 
number of samples in the corresponding bin- In an 
alterative embodiment, the value of the model parameter 
may be determined from the histogram as being the value 
of the model parameter having the highest count. 
Alternatively , a predetermined curve (such as a bell 
curve) could be fitted to the histogram in order to 
identify the maximum which best fits the histogram- 
In the above embodiment , the statistical analysis unit 
modelled the underlying speech production process with a 
separate speech source model (AR filter) and a channel 
model. Whilst this is the preferred model structure , the 
underlying speech production process may be modelled 
without the channel model. In this case, there is no 
need to estimate the values of the raw speech samples 
using a Kalman filter or the like, although this can 
still be done- However, such a model of the underlying 
speech production process is not preferred, since the 
speech model will inevitably represent aspects of the 
channel as well as the speech. Further, although the 
statistical analysis unit described above ran a model 
order selection routine in order to allow the model 
orders of the AR filter model and the channel model to 
vary, this is not essential. In particular, the model 



order of the AR filter model and the channel model may be 
fixed in advance, although this is not preferred since it 
will inevitably introduce errors into the representation. 

In the above embodiments, the speech that was processed 
was received from a user via a microphone. As those 
skilled in the art will appreciate, the speech may be 
received from a telephone line or may have been stored on 
a recording medium. In this case, the channel model will 
compensate for this so that the AR filter coefficients 
representative of the actual speech that has been spoken 
should not be significantly affected. 

In the above embodiments, the speech generation process 
was modelled as an auto-regressive (AR) process and the 
channel was modelled as a moving average (MA) process. 
As those skilled in the art will appreciate, other signal 
models may be used. However, these models are preferred 
because it has been found that they suitably represent 
the speech source and the channel they are intended to 
model . 



In the above embodiments, during the running of the model 
order selection routine, a new model order was proposed 
by drawing a random variable from a predetermined 



Laplacian distribution function. As those skilled in 
the art will appreciate, other techniques may be used. 
For example the new model order may be proposed in a 
deterministic way (ie under predetermined rules), 
provided that the model order space is sufficiently 
sampled. 



CLAIMS 



1. An apparatus for determining a quality measure 
indicative of the quality of an audio signal, the 
apparatus comprising: 

a memory for storing a predetermined function which 
gives, for a given set of audio signal values, a 
probability density for parameters of a predetermined 
audio model which is assumed to have generated the set of 
audio signal values, the probability density defining, 
for a given set of model parameter values, the 
probability that the predetermined audio model has those 
parameter values, given that the model is assumed to have 
generated the set of audio signal values; 

means for receiving a set of audio signal values 
representative of an input audio signal; 

means for applying the set of received audio signal 
values to said stored function to give the probability 
density for said model parameters for the set of received 
audio signal values; 

means for processing said function with said set of 
received audio signal values applied, to derive samples 
of parameter values from said probability density; 

means for analysing at least some of said derived 
samples of parameter values to determine a quality 
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measure indicative of the quality of the received audio 
signal values. 

2. An apparatus according to claim 1, wherein the said 
5 analysing means is operable to determine a measure of the 

variance of said at least some of said samples of 
parameter values in determining said quality measure. 

3. An apparatus according to claim 2, wherein said 
10 probability density function is in terms of said variance 

measure and wherein said processing means is operable to 
draw samples of said variance measure from said 
probability density function. 

15 4. An apparatus according to any preceding claim, 

wherein said processing means is operable to draw 
samples iteratively from said probability density 
function. 

20 5. An apparatus according to claim 3 or 4 , wherein said 

processing means comprises a Gibbs sampler. 

6. An apparatus according to any of claims 3 to 5 , 
wherein said analysing means is operable to determine a 
25 histogram of said drawn samples and wherein said quality 



measure is determined using said histogram. 



7. An apparatus according to claim 6, wherein said 
analysing means is operable to determine said quality 
measure using a weighted sum of said drawn samples, and 
wherein the weighting for each sample is determined from 
said histogram. 

8. An apparatus according to any preceding claim, 
wherein said receiving means is operable to receive a 
sequence of sets of signal values representative of an 
input audio signal and wherein said applying means, 
processing means and analysing means are operable to 
perform their function with respect to each set of 
received audio signal values to determine a quality 
measure for each set of received signal values. 

9. An apparatus according to claim 8, wherein said 
processing means is operable to use the values of 
parameters obtained during the processing of a preceding 
set of signal values as initial estimates for the values 
of the corresponding parameters for a current set of 
signal values being processed. 

10. An apparatus according to claim 8 or 9 , wherein said 
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sets of signal values in said sequence are non- 
overlapping . 



11. An apparatus according to any preceding claim, 
5 wherein said audio model comprises an auto-regressive 

process model and wherein said parameters include auto- 
regressive model coefficients. 

12. An apparatus according to any preceding claim, 
10 wherein said audio signal model includes a noise model 

having a noise parameter and wherein said quality measure 
is determined using said noise parameter. 

13. An apparatus according to any preceding claim, 
15 wherein said received set of audio signal values is 

representative of an input speech signal. 

14. An apparatus according to claim 13, wherein said 
received set of speech signal values are representative 

20 of a speech signal generated by a speech source as 

distorted by a transmission channel between the speech 
source and the receiving means; wherein said 
predetermined function includes a first part having first 
parameters which models said source and a second part 

25 having second parameters which models said channel; 
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wherein said processing means is operable to derive 
samples of at least said first parameters; and further 
comprising means for outputting values of said first 
parameters that are representative of said speech 
5 generated by said speech source before it was distorted 

by said transmission channel. 

15. An apparatus according to claim 14, wherein said 
processing means is operable to determine a histogram of 

10 said derived samples and wherein said values of said 

first parameters are determined from said histogram. 

16. An apparatus according to claim 15, wherein said 
processing means is operable to determine said values of 

15 said first parameters using a weighted sum of said 

derived samples, and wherein the weighting for each 
sample is determined from said histogram. 

17. An apparatus according to any of claims 14 to 16, 
20 wherein said processing means is operable to derive 

samples of said second parameters and wherein said 
analysing means is operable to determine said quality 
measure using the derived samples of said second 
parameters . 
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18. An apparatus according to any of claims 14 to 17, 
wherein said function is in terms of a set of raw speech 
signal values representative of speech generated by said 
source before being distorted by said transmission 
5 channel, wherein the apparatus further comprises second 

processing means for processing the received set of 
signal values with initial estimates of said first and 
second parameters, to generate an estimate of the raw 
speech signal values corresponding to the received set of 
10 signal values and wherein said applying means is operable 

to apply said estimated set of raw speech signal values 
to said function in addition to said set of received 
signal values. 



15 19. An apparatus according to claim 18, wherein said 

second processing means comprises a simulation smoother. 

20. An apparatus according to claim 18 or 19, wherein 
said second processing means comprises a Kalman filter. 

20 

21. An apparatus according to any of claims 14 to 20, 
wherein said second part is a moving average model and 
said second parameters comprise moving average model 
coefficients . 
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22. An apparatus according to any preceding claim, 
further comprising means, responsive to said quality 
measure, for comparing signals representative of the 
input audio signal with prestored models, to generate a 
comparison result. 

23. An apparatus according to claim 22, wherein said 
signals representative of the audio signal are derived 
from said stored function. 

24. An apparatus according to any of claims 1 to 21, 
further comprising means for encoding signals 
representative of the input audio signal in dependence 
upon the output quality measure. 

25. An apparatus for generating annotation data for use 
in annotating a data file, the apparatus comprising: 

means for receiving an audio annotation; 

an apparatus according to any of claims 1 to 21 for 
generating a quality measure indicative of the quality of 
the received audio signal; and 

means for generating annotation data using data 
representative of the received audio signal and said 
quality measure. 
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26. An apparatus according to claim 25, wherein said 
audio annotation comprises speech data and wherein the 
apparatus further comprises speech recognition means for 
processing the speech data to identify words and/or 
phonemes within the speech data; and wherein said 
annotation data comprises said word and/or phoneme data. 

27. An apparatus according to claim 26, wherein said 
data representative of the input speech is derived using 
said apparatus according to any of claims 1 to 21. 

28. An apparatus according to claim 27, wherein said 
annotation data defines a phoneme and word lattice. 

29. An apparatus for searching a database comprising a 
plurality of annotations which include annotation data 
and a quality measure indicative of the quality of an 
annotation used to generate the annotation data, the 
apparatus comprising : 

means for receiving an audio input query; 

means for determining a quality measure for the 
input audio query; and 

means for comparing data representative of said 
input query with the annotation data of one or more of 
said annotations in dependence upon the quality measure 
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for said input query and the corresponding quality 
measure for the annotation. 

30. An apparatus according to claim 29, wherein said 
data representative of said input query and said 
annotation data comprises word and/or phoneme data. 

31. An apparatus according to claim 29 or 30 , wherein 
said second comparing means is operable to compare said 
query data with said annotation data using a first 
comparison technique if both said quality measures exceed 
a predetermined threshold and is operable to compare said 
query data with said annotation data using a second 
comparison technique if either or both of said quality 
measures are below said predetermined threshold. 

32. An apparatus for searching a database comprising a 
plurality of information entries to identify information 
to be retrieved therefrom, each of said plurality of 
information entries having an associated annotation and 
a quality measure indicative of the quality of the 
annotation; 

means for receiving an input audio query; 
an apparatus according to any of claims 1 to 21 for 
processing said input audio query to generate a quality 
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measure therefor; and 

means for comparing data representative of the input 
audio query with said annotations in dependence upon the 
quality measure of said input query and the corresponding 
quality measures of said annotations. 

33. A method of determining a quality measure indicative 
of the quality of an audio signal, the method comprising 
the steps of: 

storing a predetermined function which gives , for a 
given set of audio signal values, a probability density 
for parameters of a predetermined audio model which is 
assumed to have generated the set of audio signal values, 
the probability density defining, for a given set of 
model parameter values, the probability that the 
predetermined audio model has those parameter values, 
given that the model is assumed to have generated the set 
of audio signal values; 

receiving a set of audio signal values 
representative of an input audio signal at a receiver; 

applying the set of received audio signal values to 
said stored function to give the probability density for 
said model parameters for the set of received audio 
signal values; 

processing said function with said set of received 
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audio signal values applied, to derive samples of 
parameter values from said probability density; 

analysing at least some of said derived samples of 
parameter values to determine a measure of the variance 
of said at least some of said samples of parameter 
values ; and 

outputting a signal indicative of the quality of the 
received audio signal values in dependence upon said 
determined variance measure. 

34. A method according to claim 33 , wherein said 
analysing step determines a measure of the variance of 
said at least some of said samples of parameters values 
in determining said quality measure. 



35. A method according to claim 34, wherein said 
probability density function is in terms of said variance 
measure and wherein said processing step draws samples of 
said variance measure from said probability density 
2 0 function. 



36. A method according to any of claims 33 to 35, 
wherein said processing step draws samples iteratively 
from said probability density function. 
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37. A method according to claim 35 or 36, wherein said 
processing step uses a Gibbs sampler. 



38. A method according to any of claims 35 to 37, 
5 wherein said analysing step determines a histogram of 

said drawn samples and wherein said quality measure is 
determined using said histogram. 

39. A method according to claims 38, wherein said 
10 analysing step determines said quality measure using a 

weighted sum of said drawn samples, and wherein the 
weighting for each sample is determined from said 
histogram. 

15 4 0. A method according to any of claims 33 to 39, 

wherein said receiving step receives a sequence of sets 
of signal values representative of an input audio signal 
and wherein said applying step, processing step, 
analysing step are performed with respect to each set of 

20 received audio signal values to determine a quality 

measure for each set of received signal values. 

41. A method according to claim 40, wherein said 
processing step uses the values of parameters obtained 
25 during the processing of a preceding set of signal values 
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as initial estimates for the values of the corresponding 
parameters for a current set of signal values being 
processed. 

42. A method according to claim 40 or 41, wherein said 
sets of signal values in said sequence are non- 
overlapping. 

43. A method according to any of claims 33 to 40, 
wherein said audio model comprises an auto-regressive 
process model and wherein said parameters include auto- 
regressive model coefficients. 

44. A method according to any of claims 31 to 40, 
wherein said audio signal model includes a noise model 
having a noise parameter and wherein said quality 
measure is determined using said noise parameter. 

45. A method according to any of claims 33 to 44, 
wherein said received set of audio signal values is 
representative of an input speech signal. 

46. A method according to claim 45, wherein said 
received set of speech signal values are representative 
of a speech signal generated by a speech source as 
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distorted by a transmission channel between the speech 
source and the receiver; wherein said predetermined 
function includes a first part having first parameters 
which models said source and a second part having second 
5 parameters which models said channel; wherein said 

processing step derives samples of at least said first 
parameters; and further comprising means for outputting 
values of said first parameters that are representative 
of said speech generated by said speech source before it 
10 was distorted by said transmission channel. 

47. A method according to claim 46, wherein said 
processing step determines a histogram of said derived 
samples and wherein said values of said first parameters 

15 are determined from said histogram. 

48. A method according to claim 47 , wherein said 
processing step determines said values of said first 
parameters using a weighted sum of said derived samples, 

2 0 and wherein the weighting for each sample is determined 

from said histogram. 

49. A method according to any of claims 46 to 48, 
wherein said processing step derives samples of said 

25 second parameters and wherein said analysing step 
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determines said quality measure using the derived samples 
of said second parameters. 

50. A method according to any of claims 46 to 49, 
5 wherein said function is in terms of a set of raw speech 

signal values representative of speech generated by said 
source before being distorted by said transmission 
channel, wherein the method further comprises a second 
processing step of processing the received set of signal 
10 values with initial estimates of said first and second 

parameters, to generate an estimate of the raw speech 
signal values corresponding to the received set of 
signal values and wherein said applying step applies said 
estimated set of raw speech signal values to said 
15 function in addition to said set of received signal 

values . 

51. A method according to claim 50, wherein said second 
processing step uses a simulation smoother. 
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52. A method according to claim 50 or 51, wherein said 
second processing step uses a Kalman filter. 
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53. A method according to any of claims 46 to 52, 
wherein said second part is a moving average model and 
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said second parameters comprise moving average model 
coefficients . 

54. A method according to any of claims 33 to 53, 
further comprising the step of comparing signals 
representative of the input audio signal with prestored 
models to generate a comparison result and wherein said 
comparing step is responsive to said quality measure. 

55. A method according to claim 54, wherein said signals 
representative of the audio signal are derived from said 
stored function. 

56. A method according to any of claims 33 to 53, 
further comprising the step of encoding signals 
representative of the input audio signal in dependence 
upon the output quality measure . 

57. A method of generating annotation data for use in 
annotating a data file, the method comprising the steps 
of: 

receiving an audio annotation; 

the method according to any of claims 33 to 53 for 
generating a quality measure indicative of the quality of 
the received audio signal: and 
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generating annotation data using data representative 
of the received audio signal and said quality measure. 

58. A method according to claim 57, wherein said audio 
annotation comprises speech data and wherein the method 
further comprises the step of using a speech recognition 
unit to process the speech data to identify words and/or 
phonemes within the speech data; and wherein said 
annotation data comprises said word and/or phoneme data. 

59. A method according to claim 58, wherein said data 
representative of the input speech is derived using said 
method according to any of claims 33 to 53. 

60. A method according to claim 59, wherein said 
annotation data defines a phoneme and word lattice. 

61. A method of searching a database comprising a 
plurality annotations which include annotation data and 
a quality measure indicative of the quality of an 
annotation used to generate the annotation data, the 
method comprising the steps of: 

receiving an audio input query; 

determining a quality measure for the input audio 
query; and 
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comparing data representative of said input query 
with the annotation data of one or more of said 
annotations in dependence upon the quality measure for 
said input query and the corresponding quality measure 
for the annotation 

62. A method according to claim 61 , wherein said data 
representative of said input query and said annotation 
data comprises word and/or phoneme data. 

63. A method according to claim 61 or 62, wherein said 
comparing step compares said query data with said 
annotation data using a first comparison technique if 
both said quality measures exceed a predetermined 
threshold and compares said query data with said 
annotation data using a second comparison technique if 
either or both of said quality measures are below said 
predetermined threshold. 

64. A method of searching a database comprising a 
plurality of information entries to identify information 
to be retrieved therefrom, each of said plurality of 
information entries having an associated annotation and 
a quality measure indicative of the quality of the 
annotation; 
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receiving an input audio query; 

using the method according to any of claims 33 to 53 
to process said input audio query to generate a quality 
measure therefor; and 
5 comparing data representative of the input audio 

query with said annotations in dependence upon the 
quality measure of said input query and the corresponding 
quality measures of said annotations. 

10 65. A computer readable medium storing computer 

executable process steps to cause a programable computer 
apparatus to perform the methods of any of claims 33 to 
64. 

15 66. Processor implementable process steps for causing 

^ a programmable computing device to perform the method 

according to any of claims 33 to 64. 



20 



92 



ABSTRACT 



SPEECH PROCESSING SYSTEM 
A speech processing system is provided which is operable 
5 to receive sets of signal values representative of a 

speech signal generated by a speech source. The system 
is operable to determine a measure of the quality of the 
speech signal by performing a statistical analysis of the 
received sets of signal values. The system stores data 

10 defining a predetermined function derived from a signal 

model which models the speech source and which defines a 
probability density function which gives, for a given set 
of model parameters, the probability that the signal 
model has those model parameters given that the signal 

15 model is assumed to have generated the received set of 

signal values. The system applies a current set of 
received signal values to the stored probability density 
function and then draws samples from it using a Gibbs 
sampler. The system then analyses the samples to 

20 determine a measure of the variance of some of the 

samples and then outputs a signal indicative of the 
quality of the received speech signal values in 
dependence upon the determined variance. 
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